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(54) Moving picture transmission system and moving picture transmission apparatus 



(57) There is disclosed a moving picture transmis- 
sion system which enhances the quality of a demand- 
refreshed image without increasing the amount of code 
to be transmitted When a picture data error has been 
detected, a reception side coder transmits to a transmis- 
sion side decoder information concerning the location 
of the error delected in a picture frame. Upon receipt of 
this information, for several frames, beginning with the 
picture frame that is distorted by the error and continuing 
up until the picture ffame preceding the frame to be 
transmitted, the transmission side determines a portion 
that may be distorted by the occurrence of the error or 
by the transmission of the error r and a picture portion 
that may be affected by distortion when picture data are 
to be coded in the inter-frame coding mode. Onty the 
pictu re portion that the transmission side determines will 
be affected is forcibly coded in the intra-frame coding 
picture mode, the other picture portions being coded in 
the normal manner, and the resultant picture data are 
transmitted to the reception side. 
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Description 

REFERENCE TO RELATED APPLICATION 

This application claims the priority right under EPC 
Art. 88 Par. 1 , of Japanese Patent Application No, He) 
07-178684 filed on July 14, 1995, the entire disclosure 
of which is incorporated herein by reference. 

BACKGROUND OF THE INVENTION 

Field of the invention 

The present invention relates to a moving picture 
transmission system, and a moving picture transmission 
apparatus that can be applied, for example, as a de- 
mand refresh system for transmitting compressed mov- 
ing picture data. 

Related Arts 

For digital communication, an enormous amount of 
image data are compressed and redundancies are re- 
moved before the resultant data are transmitted. The 
moving picture ccd\(\§ method that is specified in refer- 
ence document (1), ITU-T Recommendation H. 261 
(TTC Standards (Higher Layer Protocol Coding Method: 
Recommendation JT-f-L 261)), is atypical compression 
and coding method. When this compression method is 
empfoyed, a difference in time between a current frame 
and a preceding frame is coded (called an inter-frame 
coding mode (INTER mode)) to remove redundancies 
in the time axial direction. Or orthogonal transform is 
performed for a picture without calculating a time differ- 
ence, and the resultant data are coded (called an intra- 
f rame coding mode (INTRA mode)) to eliminate redun- 
dancies in the spacial direction. 

If an error occurs in compressed image data that 
are thus coded, a picture is greatly distorted, and since 
a time difference between the current frame and the pre- 
ceding frame is coded, the distortion In the image will 
be transmitted to a succeeding frame. To cope with such 
an error, according to the above described reference 
document (1), a Mast update request" function is provid- 
ed for a system, such as a mufti-point conference sys- 
tem, that enables bidirectional communication. 

When an error is detected at the reception slde r a 
fast update request signal is transmitted to the transmis- 
sion side. Upon the receipt of the signal, a coding device 
at the transmission side forcibly codes a s ucceeding one 
picture frame by employing the intra-frame coding 
mode, and transmits the resultant data. The frame that 
is coded by employing the infra-frame coding mode will 
not be affected by the distortion of the preceding frame. 

A process for coding a single picture frame entirely 
or partially by employing a coding mode that is not af- 
fected by the preceding image distortion and for trans- 
mitting the resultant frame (if the coding method H. 261 



referred to in the reference document (1) is employed, 
this process corresponds to the forcible coding of a sin- 
gle image frame entirely or partially in the intra-frame 
coding mode) is cafled "refreshing," and a picture that 

5 is obtained by refreshing is called a refresh picture. 

Transmission of a refresh signal from the transmis- 
sion side in response to a update request signal from 
the reception side is called "demand refreshing." 
Fig. 1 is a diagram for explaining a conventional de- 

10 mand refresh method. In Fig. 1, the elapsed time is cal- 
culated from the left to the right as a transmission side 
codes each picture frame and transmits the result to a 
reception side. The area sizes of a shaded square rep- 
resent the amount of code that is to be transmitted for 

is a single picture frame. Generally, when coding Is per- 
formed only by employing the intra-frame coding mode, 
the amount of code is greater than that which is provided 
when coding is performed by not only employing the in- 
tra-frame coding mode but also employing the inter- 

20 frame coding mode. 

Supposing that an error is detected when the third 
frame in Fig. 1 is to be decoded, the reception side trans- 
mits a fast update request signal to the transmission 
side. Upon the receipt of the fast update request signal, 

2S the transmission side forcibly codes a picture frame to 
be transmitted next (the sixth frame) by employing the 
intra-frame coding mode. 

Compared with the amount of code that is acquired 
when employing the inter-frame coding mode, there is 

30 a drastic increase in the amount of code that is acquired 
when the intra-frame coding mode is used. When the 
fast update request function, as prepared according to 
the ITU-T Recommendation H. 261 in the reference doc- 
ument (1 ), is employed for the recovery of a picture that 

35 was distorted because of an error, the entire one picture 
frame must be transmitted by emp toying the intra-frame 
coding picture mode. If a coding parameter is changed 
to avoid the overflow of a buffer, which is caused by an 
increase in the amount of code while employing the in- 

40 tra-frame coding picture mode, the quantization Is per- 
formed roughly, and there is picture deterioration due to 
block distortion. 

SUMMARY OF THE INVENTION 

45 

It is, therefore, an object of the present invention to 
provide a moving picture transmission system, and a 
moving picture transmission apparatus that can perform 
demand refreshing for coded moving picture data more 

^0 efficiently than conventional system and apparatus, 
even though the amount of code to be transmitted is not 
increased and even when a data error occurs as a result 
of an influence encountered along a transmission chan- 
nel, so that the quality of a picture that is decoded can 

55 be improved. 

To achieve the above object, according to the 
present invention, a moving picture transmission sys- 
tem, which comprises a moving picture transmission de- 
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vice A, for compressing and coding moving picture data 
that are input and for outpulting resultant coded moving 
picture data; and a moving picture transmission device 
B, for decoding said resultant coded moving picture da- 
ta, is provided that has the following structure. s 

The moving picture transmission device B of the 
present invention includes an information transmission 
apparatus for, when an error is detected in data for a 
picture frame that is obtained by decoding the resultant 
coded moving picture data or when a picture range of 10 
the resultant coded moving picture data that can not be 
decoded is detected, transmitting to the moving picture 
transmission device A a location of the error that is de- 
tected as error detection location information or the pic- 
ture range that can not be decoded as decoding disa- *s 
bled range information. 

The moving picture transmission device A of the 
present invention includes an estimation apparatus, for, 
from the error detection location Information or the de- 
coding disabled range information that is received, iden- 20 
tifying an error location in a picture frame or a decoding 
disabled range and for determining a portion of picture 
data that is affected by the error delected location, or by 
the decoding disabled range; and refreshed picture 
transmission apparatus for generating refreshed picture ^ 
data by compressing and coding the picture data by em- 
ploy in g a result obtained by the estimation apparatus 
and for transmitting the refreshed picture data to the 
moving picture transmission device B. 

According to the present invention, when the mov- 30 
tng picture transmission device B for performing decod- 
ing detects an error in data for a picture frame, which is 
obtained by decoding the coded moving picture data, 
the moving picture transmission device B transmits, as 
an error detected location, the location of the detected 35 
error information to the moving picture transmission de- 
vice A. From the received information, the moving pic- 
ture transmission device A for performing coding iden- 
tifies the error detected location in the picture f rame, and 
determines a portion of picture data that is affected by *o 
the error detection location. The moving picture trans- 
mission device A compressesand codes the picture da- 
ta by employing the estimation result to produce re- 
freshed picture data, and transmits the ref reshed pictu re 
data to the moving picture transmission device B. 

With the thus described arrangement, upon receipt 
of the error detection location information from the de- 
vice for performing decoding, the device for performing 
coding can determine a picture portion that may be af- 
fected by the error on the picture, and can perform re* so 
freshing of that portion for transmission. Therefore, 
while the amount of code to be transmitted is not in- 
creased, demand refreshing is performed more effi- 
ciently than it is conventionally, even if a data error oc- 
curs as a result of an influence encountered along a & 
transmission channel, so that the quality of the decoded 
picture can be improved. 

The moving picture transmission device B for per- 



forming decoding detects a pictu re ran ge of coded mov- 
ing picture data that can not be decoded, and transmits 
to the moving picture transmission device A the picture 
range as decodmg disabled range information. Upon re- 
ceipt of this information, the moving pictu re transmission 
device A identifies the decoding disabled range, and de - 
termines an affected portion of the picture data by the 
decoding disabled range, The moving picture transmis- 
sion device A compresses and codes the picture data 
by employing the estimation result, produces refreshed 
picture data, and transmits the data to the moving pic- 
ture transmission device B. 

With this arrangement, since, upon receipt of de- 
coding disabled range information from the device for 
decoding, the device for coding can determine a picture 
portion that may be affected by the decoding disabled 
range and can transfer a refreshed picture portion, the 
amount of code to be transmitted is not increased, and 
demand refresh can be performed more efficiently than 
it is conventtonalfy, even if adata error occu rs as a res ult 
of an influence encountered along a transmission chan- 
nel, so that the quality of the decoded picture can be 
improved. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a diagram for explaining a conventional de- 
mand refresh method; 

Fig. 2 is a diagram for explaining a demand refresh 
system according to a first embodiment of the 
present invention; 

Fig. 3 Is a functional diagram illustrating a moving 
picture coder according to the first embodiment; 
Fig. 4 is a functional diagram illustrating a moving 
picture decoder according to the first embodiment; 
Fig. 5 is an explanatory diagram for the hierarchiaf 
divisions of moving picture data; 
Fig. 6 is a diagram for explaining the process for the 
first embodiment by which a transmission side de- 
termines portions that may be affected by errors in 
frames A through D; 

Fig. 7 is a diagram for explaining the process for the 
second embodiment by which the transmission side 
determines portions that may be affected by errors 
in frames A and B; 

Fig. 8 is a dtag ram for explaining the process for the 
second embodiment by which the transmission side 
determines portions that may be affected by errors 
in frames C and D; 

Fig. 9 is an explanatory diagram for a demand re- 
fresh system according to a third embodiment; and 
Fig, 10 is a diagram for explaining the process for 
the third embodiment by which a transmission side 
determines portions that may be affected by errors 
m frames A through D. 
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DETAILED DESCRIPTION OF THE PREFERRED 
EMBODIMENTS 

The preferred embodiments in which the present in- 
vention is applied as a moving picture demand refresh 
system will now be described white referring to the ac- 
companying drawings. According to the embodiments, 
in a demand refresh method, according to which one 
moving picture frame is divided into regions having spe- 
cific sizes and data for each divided region are coded 
and the coded data are transferred, and according to 
which the reception side decodes the coded moving pic- 
ture data that are received and notifies the transmission 
side if an error has occurred, and the transmission side 
transmits a refreshed picture that is not affected by the 
error, the reception side transmits, as a notice of an error 
to the transmission side, information concerning an er- 
ror location in a picture frame. The transmission side de- 
termines a portion that may be affected by the error and 
refreshes that portion, and thereafter transmits the re- 
freshed portion. 

Further, in a demand refresh method, according to 
which one moving picture frame is divided into regions 
having specific sizes and data for each of the 6n\^b6 
regions are coded and the coded data are transferred, 
and according to which the reception side decodes the 
coded moving picture data that are received and notifies 
the transmission side if an error has occurred, and the 
transmission side transmits a refreshed picture that is 
not affected by the error, the reception side transmits to 
the transmission side, as notification of an error, infor- 
mation concerning a portion of the picture frame that the 
reception side coufd not decode. The transmission side 
determines a portion that may be affected by the error 
and relreshes that portion, and thereafter transmits the 
refreshed portion. 

In addition, when the transmission side has re- 
ceived the error location information, as notification of 
an error, from the reception sfde t the transmission side 
employs the search range of a motion vector for coding 
the moving picture to estimate the extent of a portion 
that may be affected by the e rror. Further, for the coding 
of a moving picture, the transmission side stores infor- 
mation indicating whether a region is coded or nof t and 
upon the receipt of, as an error notice, of the error loca- 
tion information from the reception side, the transmis- 
sion side employs the stored information concerning the 
coded region to estimate the extent of a portion that may 
be affected by the error. 

[First embodiment] 

Fig. 2 is a diagram for explaining a demand refresh 
system according to a first embodiment of the present 
invention. In Fig. 2, it is assumed that the eiapsed time 
is calculated from the left to the right, and a moving pic- 
ture coding and decoding device on the transmission 
side codes each picture frame and transmits the coded 



frame to the reception side. The dimension of each 
shaded rectangle represents the amount of code that is 
to be transmitted for a corresponding picture frame. The 
moving picture coding and decoding device on the 

£ transmission side includes a moving picture coder 1a 
and a moving picture decoder 1b, and a moving picture 
coding and decoding device on the reception side has 
a moving picture coder 2a and a moving picture decoder 
2b. Although, according to a conventional demand re- 

10 fresh method, when an error is detected, the reception 
side transmits to the transmission side a fast update re- 
quest signal as an error notice, in the first embodiment, 
information M concerning a detected error location in 
one picture frame is transmitted as an error notice from 
the reception side moving picture coder 2a to the trans- 
mission side moving picture decoder 1b. 

When the moving decoder 1b on the transmission 
side has t eceivedthe information M concerning the error 
location, for several frames (three frames in Fig. 2), up 

20 until a picture frame that precedes a frame that is to be 
transmitted, the transmission side determines picture 
portions that may be distorted by the error or by the 
transmission of the error, and the picture portions that 
may be affected by such distortion when they are the 

ss next to be coded in the inter-frame coding mode. Then, 
only the picture portions that the transmission side as- 
sumes to be affected are forcibly coded in the intra- 
frame coding picture mode, and the other picture por- 
tions are coded in the normal manner, 

30 

{Structures of moving picture coders 1a and 2a): 

Fig. 3 is a functional diagram for a moving picture 
coder, in Fig. 3, the moving picture coder is constituted 

55 of a source coder 201; a video multiplex coder 202; a 
transmission buffer 203; a transmission coder 204; a 
coding control 205; and an error location information 
transmission circuit 206. 

Video signals, which are original data for moving 

40 pictures, are represented by the CIF (Common Interme- 
diate Format) and the QCIF (Quarter CIF (1/4 CJF)). To 
code the moving picture data, the data are divided in a 
hierarchial manner into a GOB (Group Of Blocks), a 
macroblock and an 8 x 8 pixel block, as is shown in Fig. 

45 5 for expfaming the hierarchial divisions of moving pic- 
ture data. The numbers (CIF: 1 through 12, QCIF: 1, 3, 
5) in pictures indicate GOB numbers; numbers (1 
through 33) in the GOB indicate macroblock addresses; 
and numbers (1 through 6) in the macroblock indicate 

50 block numbers. The numbers (8) beside the block indi- 
cate the number of pixels for each side of a block. 

In the moving picture coder la, an input video signal 
is coded by source coder 201, The source coder 201 
first estimates the motion between frames for each mac- 

ss robfock. The source coder 201 then performs orthogo- 
nal transform of a prediction error for each block, and 
quantizes the result. The prediction process is normally 
performed in the tnler-frame coding mode; however, at 
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the lime of a change of scenes, original data for a mov- 
ing picture is employed for orthogonal transform (intra- 
trame coding mode). Whether orthogonal transform 
should be performed for the prediction error for motion 
compensation between frames (inter-frame coding 
mode), or for the original data of a moving picture (intra- 
frame coding mode) is determined by comparing vari- 
ance of prediction error with those of the original data. 

It is preferable that a mode for reducing the amount 
of code can be selected, In prior art, when a fast update 
request signal is received, the succeeding picture frame 
is coded in the infra-frame coding mode. On the other 
hand, in the first embodiment of the present invention, 
when error location information is received, a portion 
that may be affected by distortion due to an error is es- 
timated, and the portion is forcibly coded in the intra- 
f rame coding mode. 

A DCT (Discrete Cosine Transform) is employed for 
orthogonal transform, by which data that are expressed 
by using pixel regions are transformed to data that arc 
expressed by using frequency regions. The data that are 
now expressed by using frequency ranges and quan- 
tized are supplied to the video multiplex coder 202. The 
video multiplex coder 202 pe rf oims variable length cod- 
ing of the data that are coded by the source coder 201, 
and further multiplexes header information. 

The header information is constituted of a frame 
header (picture start code {a synchronous code for ac- 
quiring synchronization), a temporal reference, picture 
type information, and spare information), a GOB header 
(a GOB start code (a synchronous code for acquiring 
synchronization), a GOB number, quantizer information, 
and spare information), and a macrobtock header (mac- 
roblock address, macrobfock type information, quantiz- 
er information, a motion vector information, and a coded 
block pattern). 

The data that are respectively coded and multi- 
plexed by the source coder 201 and the video multiplex 
coder 202 are transmitted to the transmission buffer 
203. The transmission buffer 203 is a memory circuit for 
maintaining a constant transmission speed. The trans- 
mission buffer 203 informs the coding control 205 of the 
state of the buffer The coding control 205 provides a 
control signal to the source coder 201 to instruct the 
change in the amount of generated information. Further, 
the coding control 205 supplies a control signal to the 
video multiplex coder 202 so as to provide the content 
of the instruction concerning the change in the amount 
of information that is generated, and so as to control the 
volume of the data flow to the transmission buffer 203. 

The t ransmlsslon buffer 203 reads multiplexed data 
at a required time and transmits them to the transmis- 
sion path coder 204 The transmission coder 204 inserts 
a dummy bit into the transmission buffer 203 when it is 
empty,, and adds an error correction signal to the output 
of the transmission buffer 203, and outputs a coded bit 
sequence. 

When the error location information transmission 



circuit 206, of the moving picture coder 2a on the recep- 
tion side, that is the feature of the present invention, re- 
ceives an error detection signal (including information 
concerning an error location) from the reception side 
5 moving picture decoder 2b, the error location informa- 
tion transmission circuit 206 outputs error location Infor- 
mation. The error location information maybe output via 
the transmission coder 204 or may be output directly to 
a transmission channel 

10 in the first embodiment, upon receipt of the error 
location information from the reception side, the trans- 
mission side predicts what portion of a decoded image 
frame may be affected by distortion due to an error. 
(Structures of moving picture decoders 1b and 2b): 

Fig. 4 is a functional diagram illustrating moving pic- 
ture decoders 1b and 2b, In fig, 4, each moving picture 
decoder is constituted of a receiving decoder 207, a re- 
ceiving buffer 208, a video multiplex decoder 209, a 
source decoder 210, an error location information ro- 
se ceMng circuit 211 , and an error affected region estima- 
tion circuit 212, 

The receiving decoder 207 receives a coded bit se- 
quence from the moving picture coder 1a or 2a and re- 
moves a dummy bit. Also, the receiving decoder 207 ex- 

25 amines the bit sequence to determine whether or not an 
error is present, and when an error is found, the decoder 
207 corrects the error and sends the result to the receiv- 
ing buffer 208. The receiving buffer 208 is a memory 
circuit for guaranteeing a period of time for decoding the 

30 received data, and provides the received data to th e vid- 
eo multiplex decoder 209 at a desired time. 

Taking the hierarchiaf structure into consideration, 
the video multiplex decoder 209 performs variable 
length decoding to extract the compressed data, and 

3$ transmits the decoded data to the source decoder 210. 
When the video multiplex decoder 209 extracts the com- 
pressed data, contradict Ions might occur due loan error 
that can not be corrected by the receiving decoder 207 
(for example, a data string that is not present on a var- 

40 table length coding table is extracted), and as a result 
decoding might be impossible. When the decoding can 
not be performed, the video multiplex decoder 209 out- 
puts an errordetectbn signal (including information con- 
cerning an error location). 

45 The source decoder 210 performs compulation for 
expanding the compressed data, more specif icalfy, it 
performs inverse quantization and motion compensa- 
tion, and reproduces resultant video signals on a display 
device. The error location information receiving circuit 

so 211, which is the feature of the present invention, re- 
ceives error location information from the reception side 
moving picture coder, and transmits this information to 
the error affected region estimation circuit 2 1 2. The error 
location information that is sent from the reception side 

55 moving picture coder may be fetched by the receiving 
decoder 207 and transmitted to the error location infor- 
mation receiving circuit 211. 

The error affected region estimation circuit 21 2 em- 



5 



9 



EP0 753 968 A2 



10 



ploys the error location information to determine a por- 
tion that may be affected by distortion due to an error, 
and transmits the predicted information to the moving 
picture coder, which in turn codes, in the infra-frame 
coding mode, a picture portion that may be affected by 
the distortion. 

Fig, 6 is a diagram for explaining the estimation 
process performed by the transmission side to deter- 
mine portions that are affected by an error In Fig, 6, por- 
tions that are expected to be affected by the transmis- 
sion side are represented by shades 51 and dots 52. 
The coded data are arranged in ascending order ac- 
cording to the GOB numbers, the macroblock address- 
es and the block numbers, and are transmitted, A syn- 
chronous code is inse rted betwe en the individual GOBs 
for synchronization. 

Therefore, when an error is detected at the picture 
location as is shown in Fig. 6(a), and if the next synchro- 
nous code is detected correctly, it is assumed that the 
shaded portion 51 of the picture frame A can not be de- 
coded at the reception side. Since the variable length 
coding has been performed, once an error is detected, 
a decoding process can not be performed until the syn- 
chronous code that appears next is obtained 

tn this embodiment, for a portion that can not be de- 
coded at the reception side, the identical portion in the 
preceding frame is displayed When an error is detected 
at the reception side, the error location information is 
forwarded, to the transmission side, as the information 
for GOB number 5 and macroblock address 21 . for the 
case shown in Fig. 6(a). 

According to the coding method that is specified by 
the ITUT Recommendation H. 261 in the reference doc- 
ument (1), a motion vector lor motion compensation is 
limited to a range of +1 5 to -1 5 pixels vertically and hor- 
izontally Therefore, at most a dotted portion 52 in Fig. 
6(b) in the succeeding image frame B may be affected 
by the shaded portion 51 shown in Fig. 6(a). Further, a 
portion in the succeeding frame C that may be affected 
is the one represented by dots 53 in Fig. 6(c). 

In this manner, an estimation of what picture portion 
may be distorted is made at the transmission side and 
is indicated by the fine shading 54 in Fig. 6(d). When the 
next frame that the transmission side is to code after 
receiving the error location information is frame D, the 
picture distorted portion 54 is coded in the intra-frame 
coding mode, in addition, when the other portions are 
to be coded in the inter-frame coding mode, a portion (a 
roughly shaded portion 55 in Fig. 6(d)) that may be af- 
fected by the portion 54 is also coded in the intra-f rame 
coding mode. 

(Operation): 

The demand refresh operation will now be ex- 
plained while referring to Figs. 2, 3 and 4, First, at the 
transmission side moving picture coding and decoding 
device, a moving picture is coded by the moving picture 



coder la, and image data for the first through sixth 
frames are output via the transmission coder 204 to the 
transmission channel. The reception side moving pic- 
ture coding and decoding device uses the moving pb- 

s ture decoder 2b to receive and decode the image data 
in order, beginning with those for the first frame. Sup- 
pose that the third frame is received as shown in Fig. 2 
and is regarded as frame A. When an error is detected 
in the image data, the error location information irans- 

10 mission circuit 206 in the reception side moving picture 
coder 2a transmits, to the transmission side moving pic- 
ture decoder 1b, a GOB number and a macroblock ad- 
dress of an error location in frame A. 

Atthe transmission s ide moving picture d ecoder 1 b, 

is the error location information receiving circuit 211 re- 
ceives the error location information. Upon receipt of this 
information, the error location is detected and is sent to 
theerroraffected region estimation circuit212. The error 
affected region estimation circuit 212 employs the error 
location information to determine the error affected re- 
gion, and transmits an error affected region estimation 
signal to the moving picture coder 1 a. Consequently, the 
coding control 205 forcibly codes, in the intra-f rame cod- 
ing mode, a picture portion corresponding to the error 

2S affected region thai is obtained by the estimation that is 
made based on the error affected region estimation sig- 
nal. The coding control 205 codes the remaining picture 
portions in the inter-frame coding mode or in the intra- 
frame coding mode. The resultant coded data are trans- 

30 milled to the reception side as the sixth frame in Fig. 2. 
The reception side receives it as frame D, performs re- 
freshing on a picture for which the error has been de- 
tected, and displays the refreshed picture. 

According to the demand refresh system in the first 

55 embodiment, when the transmission side has received 
error location information, it does not always send the 
entire picture frame in the intra-frame coding mode, and 
can reduce the amount of code tobe transmitted in order 
to recover the image from the distortion that is due to 

ao the error Since the amount of code can be decreased, 
finer quantization can be performed, and deterioration 
of the image, such as block distortion, can be reduced 
More specifically, when a motion vector search 
range is used in moving picture coding, the t ransrnission 

as side moving picture coding and decoding device can 
more accurately determine error affected regions. 

The transmission side moving picture coding and 
decoding device performs Intra-frame coding for an im- 
age data portion that it is assumed to be affected, and 

so performs inter-frame coding or Intra-frame coding for the 
remaining image portions, so that the amount of coded 
data is not increased. 

Therefore, it is possible to provide a moving picture 
transmission system and a moving picture transmission 

ss apparatus which can perform demand refresh more ef- 
ficiently than it is conventionally, even though the 
amount of coded moving picture data to be transmitted 
is not increased and even if a data error occurs as a 
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result of an influence encountered along a transmission 
channel, so that the quality of decoded images can be 
enhanced. 

[Second embodiment] 

Likewise, in a second embodiment when the trans- 
mission side has received error location information M 
from the reception side, it determines which picture por- 
tion may bo affected by the error and forcibly codes the 
picture portion in the Intra-f rame coding mode, as shown 
in Fig. 2. It should be noted that a difference from the 
first embodiment is the method used for determining the 
image portion affected by the error. According to the 
method used for the second embodiment, one part of 
the frame information that was previously coded by the 
transmission side remains at the transmission side. 
When the transmission side has received error location 
information, it uses that information to reduce the size 
of a portion that is to be coded in the intra-frame coding 
mode even more than it is reduced by the first embodi- 
ment. 

The moving picture coder according to the ITU-T 
Recommendation H. 261 in reference document (1) 
does not transfer macrobfock information when there is 
no information in the maGroblock f i.e., when a motion 
vector is zero and all transform coefficients are zero. In 
the second embodiment, therefore, information about 
whether data are present or absent in the macroblock 
remains as COD (CODed Indication) information on the 
transmission side. Then, the COD information for all the 
image frames is used at the transmission skJe when the 
estimation is made as to of which image portions may 
be affected by the error 

The COD information that is required is equivalent 
to the number of frames that are received by the recep- 
tion side from the time it transmitted the error location 
information up until it receives refreshed images, i.e., 
the number of frames F from frame A through frame C 
in Fig. 2. The COD information for only the latest F 
frames remains, and the COD information for older 
frames is abandoned. 

Supposing that 0 is left when data are present in the 
macroblock and 1 is left when data are absent, data bits 
B which are maintained at the transmission side are, at 
most, set forth: 

B = [macroblock count per frame] xF (1 ) 

wherein F denotes the number of frames that are re- 
ceived during a period from the time of the transmission 
o! the error location information up until the time ol the 
receipt of the refreshed picture. 

For an example shown in Fig. 2 with a picture in the 
CIF format, the latest COD information of only (33 x 12) 
x 3 ^ 1188 bits need remain on the transmission side. 
Accordingly, the hardware load of the moving picture 



coder can be considerably reduced. 

Figs. 7 and 8 are diagrams for the estimation at the 
transmission side of ranges that may be affected by an 
error. In (a1), (b1), (d) and (d1), on the left, in Figs. 7 

£ and 8 are shown COD information that is left on the 
transmission side, and in (a2), (b2), (c2) and (d2), on 
the right, are shown shaded port ions, determined by the 
transmission side, that may be affected by the error. 
As is shown in Fig. 2, when an error is found in frame 

70 A on the reception side and is detected at location 71, 
which is indicated by an X in (a2) in Fig. 7, GOB number 
5 and macroblock address 21 are transmitted as error 
location information from the reception side to the trans- 
mission side. When a synchronous code between the 

16 GOBs is correctly detected, a portion that can not be 
decoded by the detected error corresponds to a shaded 
portion 73. 

In the same manner as in the first embodiment, the 
identical portion in the preceding frame is displayed for 

20 the portion that can not be decoded at the reception 
side, ttcan be determined by using the COD information 
{(a1 ) in Fig, 7) that remains on the t ransmission side that 
distortion has occurred only in macr oblocks 74 wherein 
data are present. Thus, a portion, determined by the 

25 transmission side, that can not be decoded at the recep- 
tion side is smaller than that in the first embodiment 

As well as for the first embodiment, since a motion 
vector is limited to a range of ± 15 pixels vertically and 
horizontally, the portion that may be affected by the error 

30 when the reception side decodes the next image frame 
B is a region 72 in (b2) in Fig. 7. Since the COD infor- 
mation ((b1) in Fig. 7) for the frame B is also maintained 
on the transmission side, it can ba determined by using 
the COD information that the error does not affect a 

55 macroblock wherein no data are present. Further, the 
range of a motion vector and th e COD information of the 
frame C are used in the same manner, so that a region 
81 in (c2) in Fig. 8 corresponds to a portion that may be 
affected by the error. Thus, only a region 82 in (d2) in 

40 Fig. 8 is required to be forcibly coded in the intra-frame 
coding mode when the error location information is sent 
to the transmission side. 

According to the demand refresh system of the sec- 
ond embodiment, when error location information is re- 

45 ceived by the transmission side, not all o! the macrob- 
locks in the succeeding picture frame are necessarily 
transmitted in the intra-frame coding mode. Only one 
part needs to be coded in the intra-f rame coding mode, 
and as a result, the amount of code to be transmitted 

so can be reduced. As the amount of code is reduced, finer 
quantization can be performed and deterioration of the 
picture, such as bfock distortion, can be reduced. Since 
only a small amount of information needs to be re- 
mained on the transmission side, the hardware load is 

ss small 

More specifically, in addition to the advantages of 
the first embodiment, to perform the compression and 
the coding of a moving picture, the moving picture cod- 
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ing and decoding device Includes means for storing, for 
each predetermined region (macroblock), information 
concerning whether or not coded data is present {veri- 
fying the presence or absence of data by using the COD 
information). Further, the moving picture coding and de- s 
coding device employs the above COD information to 
determine an error affected region, so that an assump- 
tion of the error affected region can efficiently and accu- 
rately be made. 

It is therefore possible to provide a moving picture io 
transmission system and a moving picture transmission 
apparatus that can perform demand refreshing more ef- 
ficiently than it is performed conventionally, though the 
amount of code lor moving picture data that are to be 
transmitted is not increased and even if a data error oc- 
curs as a result of an influence encountered along a 
transmission channel, so that the quality of a decoded 
image can be enhanced. 

[Third embodiment}: 20 

Fig. 9 is a diagram for explaining a demand refresh 
system according to a third embodiment of the present 
invention. As in Fig. 2, the elapse of time is calculated 
from the [eft to the fight, and a transmission side codes 2S 
each picture frame and transmits the coded frame to the 
reception side. The dimension ol each shaded rectan- 
gular represents the amount of code that is to be trans- 
mitted for one picture frame. 

in the first and the second embodiments, informa- 30 
tion M for error detected location in one picture frame is 
transmitted as an error notification. In the third embod- 
iment, information N for a picture portion (range) that 
can not be decoded by the reception side is transmitted 
as an error notification. 

Further, in this embodim ent f when the transm isston 
side has received the information N for the picture por- 
tion that can not be decoded by the reception side, for 
several frames beginning with the picture frame that is 
distorted by the error and continuing up to the image 40 
frame preceding the frame that is to be transmitted, i.e., 
for the three frames {frames A through C) in Fig. 9, the 
transmission side determines which picture portion may 
be distorted by the error or by the transmission of the 
error, and which image portion may be affected by dis- 45 
tortion when coding is to be performed in the inter-frame 
coding mode. Only the picture portions that the trans- 
mission side determines it to be affected are forcibly 
coded in the intra-frame coding mode. The other image 
portions are coded in a normal manner. so 

Moving picture coders 1a 1 and 2a 1 in the third em- 
bodiment are designed almost the same as those in the 
first and the second embodiments. As the feature of 
these coders in this embodiment, the information N that 
is sent from the reception side as the disabled decodin g ss 
picture portion is employed by the transmission side to 
determine the portion, within the picture frame that is 
decoded by the reception side, that may be affected by 



distortion due to the error. 

Fig. 10 is a diagram for explaining the estimation 
process performed by the transmission side to deter- 
mine portions that may be affected by the error. In Fig. 
10, portions that are assumed to be affected portions 
are represented by shades and dots. Coded data are 
arranged in ascendingorder according to the GOB num- 
bers, the mac roblock addresses and the block numbers, 
and are transmitted. A synchronous code is inserted be- 
tween the GOBs for synchronization, in Fig. 10(a) is 
shown an example wherein an error was detected and 
the succeeding synchronous code can not be correctly 
detected. At this time, it is assumed that a shaded por- 
tion 101 in picture frame A is not decoded by the recep- 
tion side. 

As well as in the first and the second embodiments, 
for the portion that can not be decoded by the reception 
side, the identical portion of the preceding frame is dis- 
played Once an error is delected by the reception side, 
information concerning the picture portion that can not 
be decoded by the reception side (hereinafter referred 
to as "decoding disabled range information"), i.e., from 
GOB number 5 and macroblock address 21 to GOB 
number 6 and macroblock address 33 in Fig. 10(a), is 
transmitted to the transmission side. As in the first em- 
bodiment, since the motion vector for motion compen- 
sation is limited to a range of ± 15 pixels vertically and 
horizontally, a dotted portion 102 in Fig. 10{b) corre- 
sponds to a portion in succeeding image frame B that 
may be affected by the shaded portion 101 in Fig. 10(a). 

Further, a picture portion in the next image frame C 
that may be affected is a dotted portion 103 in Fig. 10 
(c). In the same manner, a picture portion that may be 
distorted is determined by the transmission side as 
shown as a portion 1 04 that is represented by fine shad- 
ing in Fig. 10(d). When succeeding frame D is coded by 
the transmission side upon receipt of the decoding dis- 
abled range information, the portion 104 is coded in the 
intra-frame coding mode, in addition, a roughly shaded 
portion 105 in Fig. 10(d), which will be affected by the 
portion 104 when the other portions are coded in the 
inter-frame coding mode, is coded in the intra-frame 
coding mode. 

According to the demand refresh system of the third 
embodiment, the same advantages can b e achieved as 
are obtained by the first embodiment. Further, when the 
information for the picture portion that can not be decod- 
ed by the reception side is received by the transmission 
side, not all the macrobiocks in the succeeding picture 
frame are necessarily transmitted in the intra-frame cod- 
ing mode. Only one part of the macrobfocks needs to 
be coded in the intra-frame coding mode. 

The difference between the third embodiment and 
the first and the second embodiments is that a picture 
portion that may be erroneously transmitted can be re- 
freshed even though a synchronous code that immedi- 
ately follows the error detected location can not be de- 
tected. 
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More specifically, the transmission side moving pic- 
ture coding and decoding device estimates the error af- 
fected region by utilizing a motion vector search range 
for moving picture coding, and thus the accuracy of the 
estimation can be improved. 

The transmission side moving picture coding and 
decoding device performs intra-frame coding for the 
predicted image data portion, and performs inter-frame 
coding or mtra-frame coding for the other picture por- 
tions, so thai the amount of coded information Will not 
be increased. 

Therefore, for the transmission of coded moving 
picture data, it is possible to provide a moving picture 
transmission system and a moving picture transmission 
apparatus that can perform demand refreshing more ef- 
ficiently than it is performed conventionally without the 
amount of code to be transmitted being increased, even 
if a data error occurs as a result of an influence encoun- 
tered along a transmission channel, so that the quality 
of a decoded image can be improved. 

[Other embodiments}: 

(1) In the first trough the third embodiments, the 
coding method described in 1TUT Recommenda- 
tion H. 261 in reference document (1 ) has been em- 
ployed as an example. Another method, including 
the divisions of a picture frame and the range of a 
motion vector, can be employed. 

(2) In the first and the second embodiments, it's as- 
sumed that the synchronous code that imrnediateiy 
follows the error detected location can always be 
acquired. S ince "a synch ronous code can not be ac- 
quired" is included in "an error has been detected, 
" information for the location at which the synchro- 
nous code could not be acquired may be transmit- 
ted as an error notification to the transmission side. 
Inother words, under the condition in Fig, 6(a), GOB 
number 5 macroblock address 21 and GOB number 
6 macrobtock address 1 are transmitted as error lo- 
cation information to the transmission side. 

If a plurality of error locations are transmitted 
as error notices per one picture frame from the re- 
ception side to the transmission side, image data 
can be satisfactorily refreshed even though the syn- 
chronous code that immediately follows the error 
detected location can not always be acquired. 

(3) In addition, in the same manner as the second 
embodiment is developed from the first embodi- 
ment by using the COD information, in the M(6 em- 
bodiment, COD information is retained in the trans- 
mission side to reduce a portion to be refreshed. 
(A) Further, the moving picture decoders 1b and 2b 
include the error affected region estimation circuit 
212 in Fig. 4. For another embodiment, the error af- 
fected region estimation circuit 21 2 can be included 
in the moving picture co6B<fs 1a and 2a, The same 
advantage can be so obtained as is acquired when 



an error affected region is determined and coding 
control is performed by using the error location in- 
formation of the error location information receiving 
circuit 211 of the moving picture decoder 1b or 2b. 

5 (5) in the above embodiments, the picture coding 
method described in ITU-T Recommendation H. 
261 has been employed, and the present invention 
can be applied to MPEG-1 , which is a moving pic- 
ture coding method for storage media (e.g., video 

10 CD). More specifically, the present invention can be 
applied tor a DV-I (Digital Video Interactive) that is 
based on CD-ROM, Further, the present invention 
can be applied to a television conference system 
and a television telephone system. 

1& (6) Furthermore, the present invention can be used 
for MPEG-2, which is a media integration picture 
coding method, and more specifically, for a digital 
HDTV system. 

£0 As is described above, according to the present in- 
vention, a moving picture transmission device for de- 
coding includes information transmission means that, 
when an error is detected in picture frame data that are 
obtained by decoding coded moving picture data, or 
when a disabled decoding image range for the coded 
moving picture data is detected, transmits the error de- 
tected location as error detected location information or 
the disabled decoding image range as decoding disa- 
bled range information to the moving picture transmis- 

^0 sfon device for coding. Further, the moving picture trans- 
mission device for coding includes the estimation 
means, which identifies the error detected location in the 
picture frame by using the received error detected loca- 
tion information, or the decoding disabled range by us- 

35 ing the received decoding disabled range information, 
and which determines a picture portion that may be af- 
fected by the identified error detected location or by the 
picture data in the decoding disabled range, and the re- 
freshed picture transmission means, which compresses 

4o and codes the picture data by using th e resu It obtained 
by the estimation means to produce refreshed picture 
data, and transmits the refreshed picture data to the 
moving picture transmission device for decoding. As a 
result, a moving picture transmission system and a mov- 

4$ ing picture transmission apparatus can be provided 
wherein the amount of code to be transmitted is not in- 
creased, and demand refreshing is performed more ef- 
ficiently than it is performed conventionally, even if a da- 
ta error has occurred as a result of an influence encoun- 

so tered along a transmission channel, so that the quality 
of a decoded picture can be improved, 



Claims 

5$ 

1. A moving picture transmission system comprising: 
a first moving picture transmission device for 
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compressing and coding moving picture data 
that are input and for outputting resultant coded 
movmg picture data; and 
a second moving picture transmission device 
for decoding said resultant coded moving pic- s 
ture data; 

said second moving picture transmission de- 
vice including information transmission means 
for, when an error is detected in data for a pic- 
ture frame that is obtained by decoding said re- io 
sultant coded moving pictu re data, transmitting 
to said first moving picture transmission device 
a location of said error that is detected as error 
detection location information; 
said first moving picture transmission device in* is 
eluding estimation means, for, from said error 
detection location information that is received, 
identifying an error location in a picture frame 
and for making an estimation as to which pic- 
ture data portion by said error detected location 20 
is affected; and refreshed picture transmission 
means for generating refreshed picture data by 
compressing and coding said picture data by 
employing a result obtained by said estimation 
means and for transmitting said refreshed pic- 2$ 
ture data to said second moving picture trans- 
mission device. 

2. A moving picture transmission system according to 
claim 1 , wherein said estimation means of said first so 
moving picture transmission device employs a mo- 
tion vector search range for moving picture coding 
when making said estimation concerning said pic- 
ture data portion. 

35 

3. A moving picture transmission system according to 
claim 1 or 2, wherein, for compression and coding 
of moving pictures, said first moving picture trans- 
mission device further includes coded indication in- 
formation memory means for storing, for each pre- 40 
determined region, information concerning whether 

or not coded information is present, and wherein 
said estimation means employs said coded indica- 
tion information lor estimation. 

45 

4. A moving picture transmission system according to 
claim 1 , 2 or 3, wherein said first moving picture 
transmission device performs intra-f rame coding for 
data for said picture portion that is determined, and 
performs inter-frame coding or intra-frame coding &> 
lor ail remaining picture portions, 

5. A moving picture transmission system comprising: 

a first moving picture transmission device for s$ 
compressing and coding moving picture data 
that are input and for outpulting resultant coded 
moving picture data; and 



a second moving picture transmission device 
for decoding said resultant coded moving pic- 
lure data; 

said second moving picture transmission de- 
vice including information transmission means 
for, when a picture range of said resultant cod- 
ed moving picture data that cannot be decoded 
is delected, tran smitting tosaid first moving pic- 
lure transmission device said picture range that 
can not be decoded as decoding disabled 
range information; 

said first moving picture transmission device in- 
cluding estimation means, for, from said decod- 
ing disabled range information that is received, 
identifying a decoding disabled range and for 
making an estimation as to which picture data 
portion by said decoding disabled range is af- 
fected; and refreshed picture transmission 
means for generating refreshed picture data by 
compressing and coding said picture data by 
employing a result obtained by said estimation 
means and for transmitting said refreshed pic- 
ture data to said second moving picture trans- 
mission device. 

6. A moving picture transmission system according to 
claim 5 ( wherein said estimation means of said first 
moving picture transmission device employs a mo- 
tion vector search range lor moving picture coding 
when making said estimation concerning said pic- 
ture data portion. 

7. A moving picture transmission system according to 
claim 5 or 6, wherein, for compression and coding 
of moving pictures, said first moving picture trans- 
mission device further includes coded indication in- 
formation memory means for storing, for each pre- 
determined region, information concerning whether 
or not coded information is present, and wherein 
said estimation means employs said coded indica- 
tion information for estimation. 

8. A moving picture transmission system according to 
claim 5, 6 or 7, wherein said first moving picture 
transmission device performs intra-frame coding for 
data for said picture portion that is determined, and 
performs inter-frame coding or intra-frame coding 
lor all remaining picture portions. 

9. A moving picture transmission apparatus, for de- 
coding coded moving picture data, comprising: 

information outputting means for, when an er- 
ror is delected in data for a picture frame that is ob- 
tained by decoding said coded moving picture data, 
outputting a location of said error that is detected 
as error detection location information. 

10. A moving picture transmission apparatus, for de- 
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coding coded moving picture data comprising: 

information outputting means for, when a pic- 
ture range of said coded moving picture data that 
can not be decoded is detected, outputting said im- 
age range that can not be decoded as decoding dis- s 
abfed range information. 



range is affected; and 

refreshed picture transmission means for gen- 
erating refreshed picture data by compressing 
and coding said picture data by employing a re* 
suit obtained by said estimation means and for 
outputting said refreshed picture data. 



11. A moving picture transmission apparatus, for com- 
pressing and coding a moving picture and for out- 
putting coded moving picture data, comprising: 

estimation means, for, upon receipt of error de- 
tection location information obtained by a de- 
coding side during doco6'm^ of said coded mov- 
ing picture data* identifying an error location in 
a picture frame, and for making an estimation 
as to which image data portion by said error de- 
tected location is affected; and 
refreshed picture transmission means for gen- 
erating refreshed picture data by compressing 
and coding said picture data by employing a re- 
suit obtained by said estimation means and for 
outputting said refreshed picture data. 

1 2. A moving pictu re transmission apparatus according 
to claim 1 1 , where in said estimation means employs 
a motion vector search range for moving picture 
coding when making said estimation concerning 
said picture data portion. 

1 3. A moving pictu re transmission apparatus according 
to claim 1 1 or 1 2, wherein, forcompression and cod- 
ing of moving pictures, said apparatus further in- 
cludes coded indication information memory means 
for storing, lor each predetermined region, informa- 
tion concerning whether or not coded information is 
present, and wherein said estimation means em- 
ploys said coded indication information for estima- 
tion. 

1 4. A moving picture transmission apparatus according 
to claim 11, 12 or 13, wherein said apparatus per- 
forms Intra-frame coding for data for said picture 
portion that is determin ed, and pe rf orms inter-frame 
coding or intra-frame coding for all remaining pic- 
ture portions. 



16. Amoving picture transmission apparatus according 
to claim 15, wherein said estimation means em- 

10 ploys a motion vector search range for moving pic- 
ture coding when making said estimation concern- 
ing said picture data portion. 

1 7. A moving pictu re transmission apparatus according 
*s to claim 15 or 16, wherein, for compression and 

coding of moving pictures, said apparatus further 
includes coded indication information memory 
means for storing, for each predetermined region, 
information concerning whether or not coded infor- 
20 mation is present, and wherein said estimation 
means employs said coded indication information 
for estimation. 

1 8. A moving pictu re transmission apparatus according 
2& to claim 15, 16 or 17, wherein said apparatus per- 
forms intra-frame coding for data for said picture 
portion that is determined, and performs inter-frame 
coding or intra-frame coding for all remaining pic- 
ture portions. 

$o 

19. A moving picture transmission system comprising 
picture transmission apparatus, picture receiving 
apparatus and pictu re correcting means, character- 
ised in that the correcting means include means for 

as determining the portion of picture data affected 
when a picture frame is not correctly received by 
said receiving apparatus. 



40 
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15* A moving picture transmission apparatus, for com- 
pressing and coding a moving picture and for out- 
putting coded moving picture data, comprising: so 



estimation means, for, upon receipt of decoding 
disabled range information concerning a pic- 
ture range of said coded moving picture data 
for which decoding is disabled by said decoding ^ 
side, identifying a decoding disabled range, 
and for making an estimation as to which pic- 
ture data portion by said decoding disabled 
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